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1. Introduction 

In the service industry there is an increasing emphasis on achieving complete customer 
satisfaction. The production analytical laboratory has historically been driven by goals and 
objectives expressed in terms of technology rather than customer satisfaction. Managing a 
laboratory with a view toward customer satisfaction requires a change in philosophy and 
continual communication and feedback with the customer to guide and focus improvement 
efforts. In recent years, the Laboratory Services Branch of the Ministry of the Environment has 
taken steps to foster the communication and feedback necessary to form a healthy and 
productive relationship with the customer in order that our environmental analytical testing 
support meets the needs of all Ministry sampling programs. 

The Laboratory Services Branch (LSB) provides analytical support for all the Ministry's 
monitoring, compliance, abatement, enforcement and investigation activities. Until 1993, 
communication and feedback with our customers was very much of an ad hoc nature. In 
1993, however, the Laboratory Services Branch conducted a pilot survey of its West Central 
Region customers to measure their satisfaction with our services. From the information 
gathered, we identified the areas of our service on which to focus our improvement efforts. 
After the establishment of a Customer Services Unit at the Laboratory and significant effort by 
all laboratory staff to improve service in these areas, we chose to once again survey our 
customers. In February 1998, we again surveyed West Central Region customers, but we also 
included Eastern Region and Environmental Monitoring and Reporting Branch customers. 
This report presents the findings of the 1998 summary, compares the results to the 1993 
findings, discusses our successes and identifies the areas in which we will focus future 
improvement efforts. Survey results are for three customer groups. This information will be 
supplemented by an Environmental Science and Standards Division survey distributed to all 
Operations Division staff. 



2. Executive Summary 

In February 1998, 127 surveys were distributed to West Central region, Eastern region 
and Environmental Monitoring and Reporting Branch staff. The results were compiled and 
used to identify the strengths and weaknesses of the services provided by the Laboratory 
Services Branch. In Part 1 - Testing Services, questions focused on: a) data, b) laboratory 
staff, c) equipment, d) methods and e) sample reception. In addition to written comments and 
suggestions, customers ranked their satisfaction in each of these areas and ranked the 
importance of each service to the successful completion of their job. These ranks provided a 
measurable, quantitative response which will contribute to the formation of a set of 
benchmarks against which we can measure real improvement. In each of the five areas listed 
above, the questions posed were answered separately for routine, litigation and emergency 
samples as well as the sampling supplies and stores services we provide. In Part 2 - 
Reference Services, our customers provided satisfaction ratings for: a) program development 
and liaison support, b) methods development, c) training and workshops and d) guidance 
manuals and technical information. 

The overall assessment of Laboratory Branch testing services suggests a high level of 
satisfaction with the testing services we are providing. Eighty percent of the respondents rated 
our overall service as good or excellent. We excel in satisfying the customer in three major 
areas: 
© Data quality and reliability for routine, emergency and litigation data. Satisfaction 

ratings were between 88% and 93%. Data quality and reliability were deemed 

extremely important by our customers. 
& All services in connection with emergency samples. Satisfaction levels were 

consistently above 80% and were above 85% for all but the question concerning 

adequacy of methods and laboratory equipment. Emergency services were of highest 

importance to the customer. 
© Laboratory staff dependability, reliability, accessibility, response, helpfulness and most 

particularly knowledge and expertise. 

For a few of the items listed above, however, continual improvement is necessary to 
meet the high level of importance these activities hold for our customer. For example, staff 
accessibility and response was identified in follow-up discussions with regional customers as 
being of extreme importance and is, therefore, an area where we might focus to close the gap 
between customer satisfaction and importance. 

Areas identified, both in the questionnaire results and in follow-up discussions, which 
require improvement are: 

® Data turnaround time (timeliness and response) for routine and litigation data. 

® Documentation and data reporting to include guideline and other interpretive 

information, reporting unit compatibility with guidelines and improved charge back 

statements for supplies. 
© Quality and reliability of sampling supplies. 

® Provision of quick pick field guides and updated sampling guides to allow fast and 

accurate choice of sampling containers, preservatives, laboratory tests and matrix 

codes. 
® A primary contacts list for use by field staff and improved accessibility to laboratory 

information quickly for samplers in the field responding to emergencies, complaints and 

investigations. 
© Extended hour and lunch-hour availability of litigation sample reception authorization. 



3, LSB Customer Survey History 

3.1 1 993 Survey - A Baseline 

In March 1993, the Laboratory Services Branch surveyed West Central Region 
customers to assess their satisfaction wrth the services provided by our branch. This 
information assisted the newly established Customer Services Unit in setting goals and 
priorities for improving our services. Customers were asked to respond to questions designed 
to measure their satisfaction with the following areas of our service: 

analytical services 

data interpretation 

data quality 

sample management 

legal sample management 

emergency response 

project development 

documentation 

staff availability, response and helpfulness 

Ninety-two questionnaires were distributed and 28 were completed and returned 
providing a 30% response. Customers ranked their satisfaction with various aspects of our 
service and ranked the importance of each aspect of service to their work. In addition, 
customers submitted written comments on the services with which they were most satisfied 
and least satisfied, as well as extra services which they would like us to provide. In the 1993 
survey, the distinction between routine, litigation and emergency samples was made only for 
questions concerning staff availability and helpfulness and the importance of our services to 
the customer. Data quality, timeliness, sufficiency and reporting were not addressed at this 
level of detail. 

In general, customers were most pleased with the knowledge, expertise and 
helpfulness of our staff, the quality and credibility of the data we provide, our microscopic 
investigation of complaint samples, the availability of sampling containers and supplies and the 
flexibility of our service. 

Customers were least satisfied with the timeliness and response (turnaround time) of 
their sample data, the format of data reporting (via LIS final reports), our confusing and 
cumbersome sample submission/reception protocols, the inconsistent response by the 
laboratory staff to customer problem resolution, our failure to inform customers in a timely 
manner of problems with their samples, the absence of reception staff at certain times of the 
day and the slow response from staff in reluming calls from customers. 

Between 1993 and 1998 our Customer Services Unit took steps to address the areas of 
concern expressed by customers. These initiatives included: 

• Establishing and better advertising our Customer Service Hotline, now called the Help 
Desk, in an effort to provide a one-window approach for customer queries. 

• Improving customer query and complaint tracking and reviewing these monthly to 
provide ongoing identification of areas for improvement. 

• Ensuring same day outreach to customers if samples arrive with problems (e.g. wrong 
product codes, incomplete submission sheets, broken bottles, incorrect preservative) 

• Improving workload management and tracking to better anticipate workload bottlenecks 
and reassign staff so as to reduce turnaround times for analysis. 



• Improving data reporting formats with the introduction of LIMS and customized reports. 

• Ensuring the availability of staff and the timely response to customer queries. 

• Editing and revising the Guide to the Collection and Submission of Environmental 
Samples to the Laboratory to provide better and up to date information. 

3.2 1998 Survey - Reassessing Customer Satisfaction 

Between 1993 and 1998 the Laboratory Services Branch experienced significant 
changes. With the installation of a new Laboratory Information System (LIMS) we streamlined 
our analytical work by moving away from offering single test services, to offering the same 
tests but in groups of simultaneously measured analytes. We refer to these groups of 
analytes as products. The new LIMS system also provided better sample tracking and 
reporting functions. During this period, we experienced staffing and operating budget 
reductions. Consequently, a more structured approach to sample workload planning and 
management was implemented. This provided us with a better understanding of our 
customers' needs, and allowed us to accommodate our upcoming workload for the year by 
making a priori decisions regarding staffing in certain areas of the laboratory. As part of the 
Ministry reductions, the Thunder Bay, Kingston and London Regional Laboratories closed and 
the Central Laboratory in Etobicoke assumed the analytical support for all regional and district 
offices. By 1998, five years after our first survey and with these changes behind us, we chose 
to once again evaluate customer satisfaction with our services. 

In February 1998, we conducted a second survey (Appendix 1) among our customers. 
In Part 1 of the survey, questions focused on the following areas: 

• Data 

• Laboratory Staff 

• Equipment 

• Methods 

• Sample Reception 

For each of the above areas of focus we asked between one and four questions, 
requesting a response for each concerning: a) routine analytical work, b) emergency analytical 
work, c) litigation work and d) sampling supplies/stores. Although streaming the services in 
this way lengthened the survey, it allowed us to gain a better understanding of our strengths 
and weaknesses because sample handling and routing differs between routine, emergency 
and litigation samples. As the distinction between the different sample streams was not as 
clear when surveying customers in 1993, we were only able to obtain an overall satisfaction 
rating for some aspects of our service. 

In Part 2 of the 1998 survey questions focused on the following reference centre 
services that LSB is now providing: 

• Program Development and Liaison Support 

• Methods Development 

• Training and Workshops 

• Guidance Manuals and Technical Information 

In both parts of the survey, customers ranked our performance from 1 (very poor 
performance) to 5 (excellent performance) for each question. These rankings were considered 
representative of the customer's level of satisfaction. At the same time, the customer ranked 
the level of importance of each attribute to his/her job using a rank of 1 as lowest importance 
and 5 as very important. These measurements, used in conjunction with our satisfaction 



measurement, will ensure that improvement efforts are focused first on services that are most 
valuable to the customer. 

Ranked data were entered into a spreadsheet, frequency distributions for each rank 
were determined and histogram plots of the percentages of each rank were printed. 
Percentages were calculated and plots were made with and without the "0" rank of "not used". 
Within this report we present all results calculated without the rank of "0". In addition, means 
of the ranks, (excluding "0" ranks) were calculated for each question and a percentage out of 
the highest rank of 5 was calculated. This was used to represent the percent level of customer 
satisfaction with, or importance of our service. The latter was done in order to provide 
comparable satisfaction data to the data analysis completed in the 1993 survey. 
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4. 1 998 Customer Survey 

4.1 The Customer 

In 1993 we surveyed only West Central Region customers. In 1998 we again surveyed 
West Central customers but this time we included Eastern Region and the Environmental 
Monitoring and Reporting Branch. Eastern Region was selected because, with the closure in 
May 1996, of their regional laboratory in Kingston, we assumed all analytical support at our 
Central Laboratory in Etobicoke. The Environmental Monitoring and Reporting Branch (EMRB) 
was chosen as a large volume customer for whom we provide support for the Drinking Water 
Surveillance Program, Provincial Water Quality Monitoring program, Great Lakes programs 
and Biomonrtoring Programs. 

4.2 The Response - Part 1 , Testing Services 

We sent out 127 surveys of which 31 were returned, representing a 24% response. 
The bulk of the responses (23) were from Operations Division staff. Three customers returned 
an uncompleted survey indicating that they had not used the laboratory in the past year. The 
few surveys received from EMRB (5) were included in the data analysis. We feel that this is 
justified since close inspection of the EMRB surveys revealed that their concerns were very 
similar to Operations Division regional staff. Moreover, the number of responses received from 
any one regional or district office only amounted to more than five in one case; from the 
Hamilton office we received six. A breakdown of the respondents' locations is provided In 
Appendix 2. All participants filled out Part 1 of the survey. Part 2 was completed by only 7 
participants. The remainder either provided a rank of "0" - service not used, or left the area 
blank, suggesting that they are either not familiar with these services or that the survey was 
too long. 

4.2.1 Overall Assessment 



The overall assessment of our laboratory by our customers suggests a high level of 
satisfaction with our services (Figure 4.1). Similarly, the majority of our customers rank our 
services as being very important to successfully completing their job. 
Figure 4.1 
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On average, customers have a 79% level of satisfaction with our service. The 
importance of our service to the customers averages 90%. Closing the gap between the level 
of satisfaction and our importance to the customer is one of the goals in our commitment to 
continuous improvement at the Laboratory Services Branch. Further analysis of our 
questionnaire data reveals areas of our service where improvement efforts should be focused. 



4.2.2 Data/Supplies 

The first set of four questions pertained to sample data and sampling supplies, their quality 
and reliability, timeliness and response, sufficiency and usefulness and documentation and 
reporting. Customers rated their satisfaction with each item for routine, emergency and 
litigation data and their satisfaction with the sampling supplies they received. Customers also 
ranked the importance of these items to their work. 



4.2.2.1 



Quality and Reliability 



Data quality and reliability was one aspect of our service that customers ranked 
highest in 1993. There was an 88% level of satisfaction among clients at this time. In 1998, 
customers again showed confidence in the quality and reliability of the data they receive 
(Figure 4.2). 

Figure 4.2 
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Although pleased with all types of data received from LSB, customers were most 
satisfied with the Emergency sample data they received. The data shown in the histograms 
above can be converted to average levels of satisfaction (Table 4.1). 



Table 4.1 . Quality and Reliability 



Quality and Reliability 


Customer Satisfaction 1998 


Importance to Customer 1998 


Customer Satisfaction 1993 


Routine Data 


88% 


98% 


NA 


Emergency Data 


93% 


97% 


NA 


Litigation Data 


88% 


97% 


NA 


Supplies and Stores 


76% 


86% 


NA 


OVERALL 


86% 


94% 


88% 



The customer's overall confidence in the quality and reliability of data they are receiving 
in 1998 (86%) is similar to findings in 1993 (88%) In 1998, however, we have satisfaction 
estimates for each type of sample sent, as well as information about the quality and reliability 
of the sampling containers and supplies customers receive from stores and shipping staff. The 
slightly lower overall satisfaction in 1998 (86%) compared to 1993 (88%), is attributed to a 
lower satisfaction with these stores supplies (76%). This area also shows the largest 
difference between the customers need (importance) and his satisfaction with what he 
receives (Table 4.1). The problems were identified in a survey follow-up discussion held with 
West Central Region staff. Sampling staff commented that sampling containers sometimes 
arrived open rendering them unusable. In addition, samplers asked if it would be possible for 
our Stores to stock more supplies related to the needs of the sampler. The MISA and SWIP 
shuttle contents and ordering procedures also require review to ensure that they are working 
efficiently. 



4.2.2.2 



Timeliness and Response 



in terms of data receipt, timeliness and response is more commonly referred to as 
turnaround time. This is the length of time it takes for the data to appear on the customers 
desk after he has dropped off or shipped the sample to the laboratory. In 1993, timeliness and 
response was mentioned and ranked as an overall weakness in our service, however, from the 
1993 survey we were unable to determine which parts of our service were at fault for this low 
level of satisfaction. In 1998, we looked at timeliness and response as it applies to all types of 
samples including the receipt of sampling containers and supplies (including sample shuttle 
kits). 



Figure 4.3 
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Customers are most satisfied with the timeliness and response of emergency data and 
sampling supplies including shuttle kits (Figure 4.3). Indeed, many written comments on the 
surveys from West Central Region, complimented LSB on their excellent response to 
emergencies (the Plastimet emergency in particular). One survey, in fact, gave us a rank of 
"6" for emergencies as a result of Plastimet (included in the data as "5"). The ability of our 
staff to mobilize quickly and provide high quality emergency data within a very short time frame 
is an attribute in which LSB takes pride. Past improvement efforts have focused on 
emergency response protocols and procedures and it is evident from the results of this survey, 
that our efforts have led to a high degree of customer satisfaction. Customers were less 
satisfied with the turnaround time for routine and litigation data (Figure 4.3) as indicated by the 
higher percentage of very poor to average ratings. 



Table 4.2 Timeliness and Response 






Timeliness and Response 


Customer Satisfaction 1998 


Importance to Customer 1998 


Customer Satisfaction 1993 


Routine Data 


67% 


88% 


NA 


Emergency Data 


93% 


98% 


IMA 


Utlgation Data 


73% 


94% 


NA 


Supplies and Stores 


78% 


83% 


NA 


OVERALL 


78% 


91% 


60% 
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Although the overall satisfaction with our turnaround-time (78%) has improved from 
1993 (60%) (Table 4.2), we still need to focus on closing the gap between the customer's 
satisfaction with turnaround time for routine data, litigation data and supplies and the 
importance of these aspects of our service to the customer. It is evident that the timeliness of 
emergency and litigation data are foremost in the minds of the customers (94%-98% 
importance). In follow-up discussions held with regional staff, customers were willing to wait 
longer for routine results in return for having the emergency and litigation samples 
accommodated immediately. An acceptable turnaround time of 3 weeks for routine data was 
suggested by regional customers. One customer wistfully mentioned wanting a 7-day 
throughput but also felt his request to be unfeasible. 

As shown in Figure 4.3, approximately half our customers rated our turnaround time for 
routine data as good to excellent, demonstrating that not all customers were dissatisfied. In 
fact, another customer commented that sometimes results are received too quickly! In 
general, however, written comments included with the surveys stressed the need for faster 
results on routine samples in order to complete inspection reports in a timely manner, and to 
provide information to an anxious public awaiting the findings. It was suggested that the 
turnaround time for some units (microbiology and electron microscopy given as examples) was 
excellent but that other areas seem understaffed. Questions were raised by customers 
concerning the possibility of quickly obtaining data for completed analyses in a submission by 
the automatic generation of an interim report. 



4.1.4 Data Sufficiency and Usefulness 

Customers are generally well satisfied with the sufficiency and usefulness of the data 
they receive (Figure 4.4). A few, who ranked us average and sometimes poor were concerned 
with a) the usefulness of the reported data to provide answers they were seeking, particularly 
for legal samples, b) the unnecessary reporting of analytes not required, but which were part 
of the product and c) the fact that the workload negotiations did not allow them sufficient 
laboratory product allocations to meet the needs of their programs. 
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Figure 4.4 
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Table 4.3 Suffioienoy , 


and Usefulness 






Sufficiency and Usefulness 


Customer Satisfaction 1998 


Importance to Customer 1998 


Customer Satisfaction 1993 


Routine Data 


80% 


88% 


NA 


Emergency Data 


90% 


90% 


NA 


Litigation Data 


74% 


90% 


NA 


Supplies and Stores 


80% 


85% 


NA 


OVERALL 


81% 


80% 


NA 



In 1993 we did not survey customers about the sufficiency and usefulness of the data 
received. In 1998, however, it is apparent that although satisfaction is high, improvements 
could be made to close the gap between the customer's satisfaction and the importance of 
sufficiency and usefulness in the litigation area, routine analysis area and supplies and stores 
(Table 4.3). One comment made by West Central region staff concerning the usefulness of 



11 



stores/supplies was the value to the customer of stocking sampling items in our stores. 



4.1.5 Documentation and Reporting 

Between 1993 and 1998, we upgraded our sample data base management system from LIS to 
LIMS. With this upgrade, significant improvements were made to the final data reports issued 
to customers. The reports are easier to read and provide better descriptions of samples and 
methods. In addition, customized reports are also available upon request. As documentation 
and reporting was recognized as a weakness in the 1993 survey, customers now seem 
pleased with the sample data reports they receive (Figure 4.5). 



Figure 4.6 
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The weakest area of reporting relates to the supplies and stores. Charge-back statements are 
sent to regional staff outlining sample shuttle costs and costs of items ordered through the 
laboratory Stores. Customers are satisfied but not pleased with these reports. 
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Table 4.4 Documentation and Reporting 






Documentation/Reporting 


Customer Satisfaction 1998 


Importance to Customer 1998 


Customer Satisfaction 1993 


Routine Data 


80% 


87% 


NA 


Emergency Data 


85% 


95% 


NA 


Litigation Data 


83% 


92% 


NA 


Supplies and Stores 


86% 


73% 


NA 


OVERALL 


79% 


86% 


66 






By converting the ratings to average percentages and comparing importance to the 
customer with service satisfaction, it is evident that although the overall satisfaction has 
improved from 1993, customer satisfaction is still not equivalent to the importance attached to 
reporting and documentation (Table 4.4). In follow-up discussions with West Central and 
Eastern region staff, comments were related, not to the format and appearance of the final 
data reports, but instead to "extras" that should be available. 

A number of customers mentioned that including Ministry guidelines where appropriate 
in result reports would be useful. For example, when drinking water data, surface water data 
or soil sample data are reported, the Ontario Drinking Water Objectives (ODWO), the 
Provincial Water Quality Objectives (PWQO), or the Soil Decommissioning Guidelines should 
also be reported. This would only be helpful, however, if we reported the sample data and the 
guideline data in the same units. Currently, we do not report the guidelines, and in some 
cases, we report the sample data in different units than the published guidelines. Others 
mentioned the need to obtain the data in electronic format and to include interpretive 
information or more "plain" English in the reports (especially for the identification of unknowns). 
The "plain" English was more for the benefit of the public, as Ministry staff sampling in 
response to public concern, often pass the LIMS reports directly to the public. The sending of 
stores charge-backs to the wrong customer, charging the wrong budget code and the difficulty 
in report interpretation was also mentioned. These considerations will be taken into account 
with on-going improvements in our documentation and reporting. 



4.2.2 Laboratory Staff 

While the above questions were related to data, the next set of four questions 
concerned the laboratory staff and the customer service they provide. 



4.2.2.1 



Dependability and Reliability 



Laboratory staff were ranked very highly in their dependability and reliability (Figure 
4.6). Customers were very pleased with our dependability and reliability for emergency 
samples. 
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Figure 4.6 
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as all customers rated us as either good or excellent. Average satisfaction and importance to 
the customer, as calculated from mean ranks, was above 80% in all cases (Table 4.5). 



Table 4.6 Laboratory Staff Dependability anc 


Reliability 




Dependability & Reliability 


Customer Satisfaction 1998 


Importance to Customer 1998 


Customer Satisfaction 1993 


Routine Data 


86% 


87% 


NA 


Emergency Data 


90% 


97% 


NA 


Litigation Data 


87% 


98% 


NA 


Supplies and Stores 


82% 


88% 


NA 


OVERALL 


86% 


93% 


NA 



In the area of routine analysis, lab customer satisfaction meets the customer's needs, 
however, the great importance to the customer of dependable and reliable staff for litigation 
and emergency samples is a point to note. We must continue to ensure the dependability and 
reliability of laboratory staff required by the customer in these areas. 
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4.2.2.2 



Helpfulness. Accessibility and Response 



The helpfulness and the accessibility and response of laboratory staff was asked as 
two separate questions, but the results are discussed together in this section (Figure 4.7 and 
Figure 4.8). 

Staff are generally pleased with the helpfulness, accessibility and response provided by 
our staff and a few written comments praised particular staff in this area (Figures 4.7 and 4.8). 
Areas ranking lowest included stores/supplies and a small number of very poor ranks for 
routine analysis. In follow-up discussions with survey participants it was mentioned that 
regional staff do not know who to contact at LSB with specific problems and that a primary 
contacts list would help them obtain information quickly. Survey results indicated that 41% of 
customers obtained most of their information through the HelpDesk and 59% contacted 
individual staff. In the case of phone calls directly to staff, we found that customers rely on the 

Figure 4.7 
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same individual who has been helping them for many years to answer all their laboratory 
related questions. Customers will continue calling a technical staff member who has been 
helpful in the past. In some cases individual staff were difficult to reach. Promotion of the 
HelpDesk as a one window through which to route all calls for help and advise, would help to 
overcome the difficulty of reaching technical staff. 
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Figure 4.8 
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Table 4.6 Helpfulness and Accessibility and Response 



Helpfulness, Accessibility 
and Response 


Customer Satisfaction 1998 

Helpfulness Accessibility 
& response 


Importance to Customer 1998 

Helpfulness Accessibility 
& response 


Customer Satisfaction 1993 

Helpfulness Accessibility 
& response 


Routine Samples 


92% 


85% 


91% 


91% 


NA 


NA 


Emergency Samples 


98% 


94% 


93% 


99% 


NA 


NA 


Litigation Samples 


92% 


83% 


91% 


91% 


NA 


NA 


Supplies and Stores 


83% 


84% 


88% 


91% 


NA 


NA 


OVERALL 


91% 


87% 


91% 


93% 


88% 


NA 



For routine and litigation services, LSB staff are more helpful than they are accessible (Table 
4.6). Once the customer finds the staff to help them, we help them very well. The importance 
of accessibility and response to the customer is higher than helpfulness. This was stressed in 
follow-up discussions with West Central Region staff, who indicated that when investigating an 
emergency or complaint, they must be able to speak to lab staff immediately, should they 
require information. This is evident from the 99% level of importance given to emergency 
samples. 
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4.2.2.3 



Laboratory Staff - Knowledge and Expertise 



In all areas of our service, customers have a high regard for the knowledge and 
expertise provided by our staff (Figure 4.9). These results are in keeping with the findings of 
the 1993 survey. 

Figure 4.9 
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Table 4.7 Laboratory Staff ■ Knowledge and Expertise 



Knowledge and Expertise 


Customer Satisfaction 1998 


Importance to Customer 1998 


Customer Satisfaction 1993 


Routine Data 


90% 


92% 


NA 


Emergency Data 


97% 


97% 


NA 


Litigation Data 


92% 


94% 


NA 


Supplies and Stores 


84% 


86% 


NA 


OVERALL 


91% 


94% 


98% 



Percent satisfaction with our knowledge and expertise compare favourably with its importance 
to our customer and with the findings from 1993. 
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4.2.3 



Adequacy 



4.2.3.1 



Laboratory Equipment. Methods and Protocols 



The question regarding adequacy of laboratory equipment and adequacy of methods 
and protocols provided little valuable information. Out of the 28 respondents, 15 and 12 
respectively replied with a rating of "0" - not used, indicating to us that the customers know little 
about the adequacy of our equipment and methods. For this reason the graph is not displayed 
in this report. Written comments revealed that they hoped these aspects of our service were 
adequate, but they did not know. The rating distribution among the respondents who provided 
a satisfaction rank, was virtually identical for both questions, primarily 4's (good) and 5's 
(excellent). The few who rated us as poor to average in this area provided comments 
indicating that the methods and protocol documents were not easily accessible and that it is 
difficult to keep up to date regarding the methods being used. Among those who responded to 
these questions, adequate laboratory equipment was very important to the customer and 
adequate methods and protocols were important. These aspects of the laboratory were not 
surveyed in 1993. 



4.2.3.2 



Sample Reception 



Our final question in Part 1 was related to the adequacy of sample reception practices and 
protocols. The findings (Figure 4.10) suggest that, all samplers are well satisfied with the 
reception of emergency samples, and for the most part, routine and litigation samples, the 
latter, however, offer some room for improvement. Written comments and follow-up 

Figure 4.10 
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discussions with regional staff, identified the cumbersome nature of the submission procedure, 
especially in trying to choose LIMS products. Customers need product and sample matrix 
coding information, and to information on the number and types of bottles required for each 
product, in an easily accessible form. This information is often required at the sampling 
location. Suggestions included a better sampling guide, a better LIMS manual, an electronic 
spreadsheet which one can query to find the information quickly, having the information on 
Infoshare or the Intranet site, and having a Top Ten quick pick which gives a listing of the most 
commonly requested products, the bottles and preservatives required and LIMS codes. 
Further suggestions included providing listings of all analytes in a given product. Our current 
work on preparing a field quick-pick guide was received with much enthusiasm. 

Sample reception staff availability was an area identified during our follow-up 
discussions as needing improvement. Samplers often cannot return from the field until late in 
the day and are unsure as to the procedure for dropping off samples. Written instructions 
should be available when this occurs. Samplers dropping off litigation samples asked that 
more LSB staff be authorized to accept and sign for these samples, as the technical litigation 
staff are not always available, especially over the lunch hour. One comment mentioned the 
need for a more positive attitude among sample reception staff and suggested renovations to 
the sample reception area, including an office for the sampler to use to fill out the submission 
forms. 



Table 4.8 Adequaoy of Sample Reoeption Praotioes and Protoools 



Sampla Recaption 


Customer Satisfaction 1898 


Importance to Customer 1098 


Customer Satisfaction 1003 


Routine Data 


80% 


90% 


NA 


Emergency Data 


92% 


92% 


NA 


Legation Data 


81% 


89% 


NA 


OVERALL 


84% 


90% 


84% 



Despite the written comments suggesting improvements and the few low ratings, 
customers are considerably more satisfied with sample reception procedures and protocols 
than they were in 1993 (Table 4.8). 



4.3 The Response - Part 2, Referenoe Centre Servioes 

The questions concerning the Reference Centre Services we offer (see survey 
Appendix 1), Program Development and Support, Methods Development, Training Workshops 
and Guidance and Technical Information, were, for the most part, left unanswered. Reasons 
for this include a lack of awareness by the customer that these services are available, limited 
use by the customers and the fact that LSB reference services are directed more toward to 
specific ministry customer groups, such as Standards Development Branch (not surveyed) and 
to external stakeholders, such as private sector and municipal laboratories. 
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4.4 Summary and Conolusions 

Our customers are generally satisfied with the analytical testing services provided by 
LSB. The overall assessment of our services is generally good to excellent with analytical 
services being very important to the customers. Customer satisfaction averages between 70% 
and 90% for most service areas (Figure 4.1 1). The lowest levels of satisfaction are turnaround 
times for routine and litigation data, documentation and reporting of sampling supply charge- 
back costs, and the quality and reliability of sampling containers upon receipt by the sampler (i. 
e. open containers). Laboratory Services Branch customers are most satisfied with services in 
support of emergency samples. Where comparisons were available, it appears analytical 
services have improved considerably since 1 993. The Laboratory Services Branch also 
provides a very valuable service in support of Ministry sampling programs as indicated by the 
high ratings of importance to the customer for each category. Through continuous evaluation 
and improvement, there is an opportunity for the Branch to close the gap between the 
importance to the customer and the customer's satisfaction, for each service 

The survey results also included many written comments from our customers. Follow- 
up discussions were held with West Central and Eastern region customers to confirm and 
allow elaboration on these written comments. From the rankings and percent satisfactions 
figures summarized above, comments and suggestions received on the survey and in these 
post survey discussions we identified the following areas on which to focus our improvements: 



Turnaround times for routine and litigation samples 

Automatic generation and sending of available data when the submission is held up by 

one or more products. 

Documentation and reporting of sampling supplies (shuttle kits etc.) 

Quality and reliability of sampling supplies upon arrival (ie. Open bottles) 

Incorporation of Ministry objectives and guidelines into the final report with exceedance 

flags on values higher than the objectives/guidelines. 

Reporting of data and the Ministry objective and guidelines in the same measurement 

units to allow for easy comparison. 

Improvement of the sampling/LIMS guide to allow fast identification of sample matrix, 

appropriate product codes and number of field sample containers required. 

A quick pick guide or computer program to aid samplers in choosing the correct coding 

for submission forms. 

A primary LSB contacts list showing "who does what" at LSB as well as promotion of 

the Help Desk as a one-window approach. 

Accessibility to Sample Reception, litigation and routine technical staff during all hours 

of the workday. 
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Figure 4.1 1 Customer Satisfaction 
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APPENDIX 1 
THE 1998 CUSTOMER SURVEY 



Laboratory Services Branch - Customer Survey - January, 1998 p, * e 



If you have not used the services of the Laboratory Services Branch, in the past year, or are not a customer of 
the Laboratory Services Branch, please make a mark in the box below and return this page only, by fax, to 
(416) 235-6312. Thank You. 



□ 



If you have used the services of the Laboratory Services Branch in the past year and have time to complete this 
Customer Survey for us, please proceed (we estimate this survey will take 30-45 minutes to complete). This 
survey will help the laboratory assess how well our services meet your needs and will contribute to form a set of 
benchmarks, based upon your expectations, and against which we can measure real improvements in our 
services. 

First, we need a little information about you. Please indicate, for your job: 

I focus on the following area(s) which use or require laboratory services (please check all that apply): 

Ambient monitoring Complaint/ Legal investigations 

Industrial or Municipal abatement Standards Development 

Contact with private/ municipal labs Technology assessment /optimization 

Program planning and development Field sampling/ analysis 

Data Reporting (within government) Data Reporting (public) 
Other (please specify): 

If you include your name and location information, we will send you a copy of the findings of our survey. 



Name: 

Office: 

Address: — 

City: 

Postal code: 

Phone: 

FAX: 



Your Overall Assessment of Analytical Laboratory Services from Laboratory Services Branch 

How do you rate our overall service? 

(It may be easier if you fill out the remainder of the survey and then return to this question) 






Testing Services - Part 1 Reference Centre Services - Part 2 

LSB Service Delivery 

012345 012345 

Importance to your Job 

012345 012345 

Rating scheme: if not used; 1 if service is poor or unimportant to your job; 5 if service is excellent or of critical importance to your job. 



H »- 2 - Laboratory Services Branch - Customer Survey - January, 1998 

PART 1 - Testing Services 

DATA/ SUPPLIES 

For each of the following questions, consider your experience in the past 12 months and for each category circle the ap propriate 
number between 1 and 5. with 1 being least satisfied or lowest importance and 5 being most satis fied or highest importance. Please 
circle "0" if vou cannot assess or did not use the service in the past 12 months. After each question feel free to include remarks or 
suggestions on how the service could be improved to meet your specific needs. 

Routine Analysis Emergency Analysis Litigation Analysis Sampling Supplies & 

Stores 



QUALITY AND RELIABILITY : Your OVERALL SATISFACTION with the quality and reliability 

012345 012345 012345 012345 

HOW IMPORTANT are the quality and reliability of the service to your job. 

012345 012345 012345 012345 

Additional NEEDS OR MAKE A SUGGESTION for how quality and reliability could be improved to better meet your needs. 



TIMELINESS AND RESPONSE : Your OVERALL SATISFACTION with the timeliness of the data/ service returned to you 

012345 012345 012345 012345 

HOW IMPORTANT is the timeliness of the data/ service to your job. 

012345 012345 012345 012345 

Additional NEEDS OR MAKE A SUGGESTION for how data/ service timeliness or laboratory responsiveness couid be improved to better meet your 
needs (What is your turn aroud time need - quantify your expectation - how many days?). 



SIFF1CIENCY : Your OVERALL SATISFACTION with the volume, amount or sufficiency of the data/ services returned to you. 

012345 012345 012345 01234 5 

HOW IMPORTANT is the amount or sufficiency of this service to your job. 

012345 012345 012345 012345 

Additional NEEDS OR MAKE A SUGGESTION for how the volume, amount or sufficiency of data/ services could be improved to better meet your needs. 



LABORATORY REPORTS / LIMS : Your OVERALL SATISFACTION with the quality of reporting and documentation 

Stores Charge-back Statements 

012345 012345 012345 012345 

HOW IMPORTANT is the quality of reporting and documentation to your job. 

012345 012345 012345 012345 

Additional NEEDS OR MAKE A SUGGESTION for how reporting or documentation quality could be improved to better meet your needs. 



Rating scheme: if not used; 1 if service is poor or unimportant to your job; 5 if service is excellent or of critical importance to your job. 



Laboratory Services Branch - Customer Survey - January, 1998 Pase ' 3 * 



PART 1 - Testing Services 



LABORATORY STAFF 



For each of the following questions, consider your experience in the past 12 months and for each category circle the appropriate number 
between 1 and 5. with 1 being least satisfied or lowest importance and 5 being most satisfied or highest importance. Please circle "0" if vou 



cannot assess or did not use the service in the past 12 months. After each question feel free to include remarks or suggestions on how the 



service could be improved to meet your specific needs. 

Routine Analysis Emergency Analysis Litigation Analysis Sampling Supplies & 

Stores 



DEPENDABILITY AND RELIABILITY : Your OVERALL SATISFACTION with the dependability and reliability of LSB staff 

012345 012345 012345 012345 

HOW IMPORTANT is the dependability and reliability of the laboratory staff to your job. 

12345 012345 012345 012345 

Additional NEEDS OR MAKE A SUGGESTION for how quality and reliability could be improved to better meet your needs. 



ACCESSIBILITY AND RESPONSE : Your OVERALL SATISFACTION with the accessibility and timeliness of response by LSB staff. 

012345 012345 012345 012345 

HOW IMPORTANT is laboratory staff accessibility and timeliness to your job. 

012345 012345 012345 012345 

Additional NEEDS OR MAKE A SUGGESTION for how staff accessibility or timeliness could be improved to better meet your needs (quantify). 



When calling the Laboratory Services Branch, whom do you most often call: Helpdesk Individual Staff 

□ □ 

HELPFULNESS : Your OVERALL SATISFACTION with the helpfulness or willingness to help displayed by LSB staff 

012345 012345 012345 012345 

HOW IMPORTANT is the helpfulness or willingness to help by laboratory staff to your job. 

012345 012345 012345 012345 

Additional NEEDS OR MAKE A SUGGESTION for how laboratory staff helpfulness could be improved to better meet your needs. 



KNOWLEDGE AND EXPERTISE : Your OVERALL SATISFACTION with the quality of LSB staff knowledge and Expertise 

012345 012345 012345 012345 

HOW IMPORTANT is the knowledge and expertise of laboratory staff to your job. 

012345 012345 012345 012345 

Additional NEEDS OR MAKE A SUGGESTION for how laboratory staff knowledge or expertise could be improved to better meet your needs. 



Rating scheme: if not used; I if service is poor or unimportant to your job; 5 if service is excellent or of critical importance to your job. 



p*^- 4 - Laboratory Services Branch - Customer Survey - January, 1998 

PART 1 - Testing Services 

ADEQUACY OF SERVICES 



For each of the following questions, consider your experience in the past 12 months and for each category circle the appropriate number 
between 1 and 5. with 1 being least satisfied or lowest importance and 5 being most satisfied or highest importance. Pleas e circle "0" if vou 



cannot assess or did not use the service in the past 12 months . After each question feel free to include remarks or suggestions on how the 






service could be improved to meet your specific needs. 

Routine Analysis Emergency Analysis Litigation Analysis Sampling Supplies & 

Stores 



= 



labor atory KQi ip m KM: Your OVERALI s,\ nSFACTION with the adequacy and reliability of laboratory equipment to meet your needs 
012345 012345 012345 012345 

HOW IMPORTANT is the adequacy of laboratory and reliability of the laboratory equipment to your job. 

012345 012345 012345 012345 

Additional NEEDS OR MAKE A SUGGESTION for how laboratory equipment adequacy and reliability could be improved to better meet your needs. 



LABORATORY METHODS AND PROTOCOLS : Your OVERALL SATISFACTION with the adequacy of methods and published protocols 
012345 012345 012345 not applicable 

HOW IMPORTANT are laboratory methods and publications to your job. 

012345 012345 012345 not applicable 

Additional NEEDS OR MAKE A SUGGESTION for how laboratory methods and publications could be improved to better meet your needs (quantify). 



■SAMPLE RECEPTION : Your OVERALL SATISFACTION with the Sample Reception practices and protocols 

012345 012345 012345 not applicable 

HOW IMPORTANT is the samples submission and practices to your job. 

012345 012345 012345 not applicable 

Additional NEEDS OR MAKE A SUGGESTION for how sample submission and practices could be improved to better meet your needs. 



Thank you for taking the time to complete this part of our survey. 

DON'T FORGET TO RETURN TO THE FRONT PAGE AND RATE OUR OVERALL SERVICE ! 

Please either drop this survey in an interoffice mail envelope or Fax it to: 

Laboratory Services Branch 

Attn: Customer Services Survey 

125 Resources Rd 

Etobicoke 

FAX: (416) 235-6312 

If you also use the Laboratory Reference Centre Services, please continue on the next page. 



Rating scheme: if not used; I if service is poor or unimportant to your job; 5 if service is excellent or of critical importance to your job. 



Laboratory Services Branch - Customer Survey - January, 1998 

PART 2- Reference Centre Services 

SERVICES & SUPPLY 



Page -5- 



For each of the following questions, consider your experience in the past 12 months and for each category circle the appropriate number 
between I and 5. with 1 being least satisfied or lowest importance and 5 being most s atisfied or highest importance. Please circle "0" if vou 



:annot assess or did not use the service in the past 12 months . After each question feel free to include remarks or suggestions on how the 



. 



service could be improved to meet your specific needs. 

Program Development, Methods Development Training & Workshops Guidance Manuals & 
Liaison & Support Technical Information 



VALUE AND RELIABILITY : Your OVERALL SATISFACTION with the value and reliability of the service provided. 

012345 012345 012345 012345 

HOW IMPORTANT is the value and reliability of the service to your job. 

012345 012345 012345 012345 

Additional NEEDS OR MAKE A SUGGESTION for how value and reliability could be improved to better meet your needs. 



TIMELINESS AND RESPONSE : Your OVERALL SATISFACTION with the timeliness of the service provided. 

012345 012345 012345 012345 

HOW IMPORTANT is the data/ service timeliness to your job. 

012345 012345 012345 012345 

Additional NEEDS OR MAKE A SUGGESTION for how LSB Reference Services timeliness or response could be improved to meet your needs. 



SUFFICIENCY : Your OVERALL SATISFACTION with the volume, amount or sufficiency of the services provided. 

012345 012345 012345 012345 

HOW IMPORTANT the services volume, amount or sufficiency is to your job. 

012345 012345 012345 012345 

Additional NEEDS OR MAKE A SUGGESTION for how the volume, amount or sufficiency of services could be improved to better meet your needs. 



DOCUMENTATION AND REPORTING : Your OVERALL SATISFACTION with the quality of reporting and documentation 

012345 12345 012345 012345 

HOW IMPORTANT are the reporting and documentation quality to your job. 

012345 012345 012345 012345 

Additional NEEDS OR MAKE A SUGGESTION for how reporting or documentation quality could be improved to better meet your needs. 



Rating scheme: if not used; 1 if service is poor or unimportant to your job; 5 if service is excellent or of critical importance to your job. 



TO 

f"^-*- Laboratory Services Branch - Customer Survey - January, 1998 

PART 2- Reference Centre Services 

■laboratory STAFF 

Wfot each of the following questions, consider your experience in the past 12 months and for each category circle the appropriate number 
between 1 and 5. with 1 being least satisfied or lowest importance and 5 being most sat isfied or highest importance. Please circle "0" if vou 



annot assess or did not use the service in the past 12 months . After each question feel free to include remarks or suggestions on how the 



ervice could be improved to meet your specific needs. 

Program Development Methods Development Training & Workshops Guidance Manuals & 
& Support Technical Information 



.,'■■; 



DEPENDABILITY AND RELIABILITY : Your OVERALL SATISFACTION with the dependability and reliability 



012345 012345 012345 01234 5 

HOW IMPORTANT IS the dependability and reliability of the laboratory staff to your job. 

012345 012345 012345 012345 

Additional NEEDS OR MAKE A SUGGESTION for how quality and reliability could be improved to better meet your needs. 

ACCESSIBILITY AND RESPONSE : for each category of reference centre services you have used or had contact with in the past year, please indicate: 



Your OVERALL SATISFACTION with the accessibility and timeliness of response by the laboratory staff to you 

012345 012345 012345 12345 

HOW IMPORTANT is laboratory staff accessibility and timeliness to your job. 

012345 012345 012345 12 3 4 5 

Additional NEEDS OR MAKE A SUGGESTION for how staff accessibility or timeliness could be improved to better meet your needs (quantify). 



HELPFULNESS : for each category of reference centre services you have used or had contact with in the past year, please indicate: 
Your OVERALL SATISFACTION with the helpfulness or willingness to help displayed by laboratory staff 

012345 012345 012345 012345 

HOW IMPORTANT is the helpfulness or willingness to help by laboratory staff to your job. 

012345 012345 012345 01234 5 

Additional NEEDS OR MAKE A SUGGESTION for how laboratory staff helpfulness could be improved to better meet your needs. 



KNOWLEDGE AND EXPERTISE : for each category of reference centre services you have used or had contact with in the past year, please indicate: 
Your OVERALL SATISFACTION with the quality of laboratory staff knowledge and Expertise 

12345 012345 012345 012345 

HOW IMPORTANT is the knowledge and expertise of laboratory staff to your job. 

012345 012345 012345 012345 

Additional NEEDS OR MAKE A SUGGESTION for how laboratory staff knowledge or expertise could be improved to better meet your needs. 



Rating scheme: if not used; I if service is poor or unimportant to your job; 5 if service is excellent or of critical importance to your job. 









APPENDIX 2 
Location of Survey Participants 


















West-Central Region: 



Response to the Survey 



Number of Responses 



Hamilton Regional Office: 
Niagara District Office: 



6 
5 



Eastern Region 



Kingston Regional Office: 
Peterborough District Office: 
Cornwall District Office: 
Ottawa District Office: 
Belleville District Office: 



2 
2 
1 
5 
1 



Environmental Monitoring and Reporting 
Branoh 



No name and address 



Response-Do not use LSB Services 



TOTAL: 



31 



HC 


Laboratory Services Branch 


120 


customer survey 1998 : 
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summary of findings / 
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